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IMAGING SYSTEM WITH MULTIPLE BOOT OPTIONS 



BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to the field of image sensors and imaging systems. 

Description of the Related Art 

Imaging systems, such as digital cameras, are used for still photography and video recording. The 
images captured by such ^tems n^y be used for viewing and/or further processing in a variety of 
representations, such as electronic, digital, or printed. A typical imaging system is built from a multiplicity of 
individual components that are integrated into a functional system. 

Fig. 1 shows a schematic block diagram of an imaging system 100 of the prior art. System 100 has an 
electronic image sensor 102 that receives Kght through an optical interface 104. The optical interface may 
comprise a lens system, an aperture mechanism, and/or a Ught filter. Settings of the optical interface, e.g., 
zoom and aperture size, can be mechanically adjusted according to the user input using a motor 106. 

The sensor may be implemented as a charge coupled device (CCD) or an array of complementary 
metal oxide semiconductor (CMOS) photosensitive circuits that generate electrical signals in response to the 
incident Ught. Analog signals from the sensor are converted by an analog-to-digital converter (ADC) 108 into 
digital image data and transferred for storage and/or further processing into a random access memory (RAM) 
110. The data may be processed by a programmed processor 112 using algorithms stored in a read-only 
memory (ROM) 114. The processed image data may then be stored back to RAM 110 within system 100 
and/or transferred to an external system, such as a personal conq)uter, through interface 116 for storage as an 
electronic file and/or for fiirther graphical and image processing, e.g., to enhance the image or for use with 
graphics software. The electronic components of system 100, such as sensor 102, ADC 108, memories 110 
and 114, processor 112, and interface 116, are typically configured on a printed circuit board (PCB) 118. 

Imaging systems, such as system 100, enable a user to manipulate mechanical buttons, knobs, toggle 
switches, etc., to select a few settings, most commonly, of the optical interface. However, many of the system 
features are often based on system software executed by processor 112. SuppHers of imaging systems, such as 
system 100 of Fig. 1, load the software into ROM 114 and select software-based feature settings for their 
imaging systems. Because cost-effective on-chip ROM is often made by the process of photomicrolithography 
and becomes a permanent part of the circuit design, such ROM cannot be modified once the product design is 
finished. This lack of flexibility of on-chip ROM makes it impossible to correct defects found later in the 
software, to add new features, or to use the imaging system for new purposes. 
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SUMMARY OF THE INVENTION 
Embodiments of the present invention provide a system and method for enabhng a user to select a 
' mode of operation, add imaging system features, update software, and allow customization of the imaging 
5 system for different applications. In one embodiment, the present invention is an integrated system-on-a-chip 
(SOC) imaging system with multiple boot options. The imaging system can boot using one or more 
configurations stored either internally or externally, wherein a mode of operation can be selected or the 
imaging system can be configured for different applications. Consequently, multiple market segments can be 
served by essentially the same hardware, while local customization can be achieved by configuring the 
1 0 imaging system fi:om a plurality of available boot options according to the intended appKcation. In addition, 
according to embodiments of the present invention, an imaging system allows users to load new software, add 
a new capability, such as interfacing with a new type of device, or implement a troubleshooting operating 
mode for maintenance and diagnostics. This simplifies development of imaging systems and can result in 
1^ more efficient product support. 

|| According to one embodiment, the present invention is an imaging system comprising an image 

Q sensor, a memory, and a processor, wherein the image sensor is configured to generate image signals 

is 

f ^ corresponding to an image of a scene; the processor is configured to control operations of the imaging system 

Ml , 

y 5 m one or more operating modes enabled by one or more configurations accessible by the processor; and the 
memory is configured to store the one or more configurations accessed by the processor to control the 

^ operations of the imaging system. 

According to another embodiment, the present invention is a method of operating an imaging system, 
the imaging system comprising an image sensor, a memory, a processor, and interface pins, the method 

m 

comprising the steps of (1) applying a voltage pattern to the interface pins; and (2) accessing a configuration 
corresponding to the voltage pattern, wherein the image sensor is configured to generate image signals 
25 corresponding to an image of a scene; the processor is configured to control operations of the imaging system 
in one or more operating modes, wherein the accessed configuration enables at least one of the operating 
modes; and the memory is configured to store one or more configurations accessible by the processor. 

BRIEF DESCRIPTION OF THE DRAWINGS 
30 Other aspects, features, and advantages of the present invention will become more fully apparent fi-om 

the following detailed description, the appended claims, and the accompanying drawings in which: 
Fig. 1 is a schematic block diagram of an imaging system of the prior art; 
Fig. 2 shows a schematic block diagram of an imaging system according to one embodiment of the 
present invention; 
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Fig. 3 shows a schematic block diagram of the imaging system of Fig. 2 and a platform enabling 
external boot options for the imaging system and a capability to load new software according to another 
embodiment of the present invention; and 

Fig. 4 is a flowchart illustrating a method of operation of the imaging system of Fig. 2 and the imaging 
system and platform of Fig. 3. 

DETAILED DESCRIPTION 

Reference herein to "one embodiment" or "an embodiment" means that a particular feature, structure, 
or characteristic described in connection with the embodiment can be included in at least one embodiment of 
the invention. The appearances of the phrase "in one embodiment" in various places in the specification are 
not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually 
exclusive of other embodiments. The description herein is largely based on a particular imaging system based 
on CMOS technology and system-on-a-chip (SOC) imaging system architecture. Those skilled in the art can 
appreciate that the description can be equally appUed to other imaging systems. 

Fig. 2 shows a schematic block diagram of an imaging system 200 according to one embodiment of the 
present invention. System 200 comprises a digital image sensor 202, an on-chip memory 204, a processor 
206, an interface 208, a register 210, and a read-only memory (ROM) 212, preferably all integrated on a single 
chip as an SOC. System 200 further comprises interface pins 214. Sensor 202 is configured to generate image 
data in response to incident light and transfer the data to memory 204. One particular in:q)lementation of an 
image sensor, such as sensor 202, is a digital pixel sensor described in U.S. Patent No. 5,461,425 (Fowler et 
al.), the teachings of which are incorporated herein by reference. 

Processor 206 is configured to access and process the data stored in the memory. Data processing may 
include but is not limited to data interpolation, noise reduction, color adjustment, and/or geometric corrections 
due to optical aberrations. Processor 206 is further configured to interpret and execute external commands 
received through pins 214 and interface 208. Register 210 is configured to store addresses of operating 
routines and/or sets of configuration parameters. ROM 212 is configured to store (a) intemal bootable 
software comprising one or more operating routines and possibly (b) additional sets of configuration 
parameters. To enable a particular operating mode for system 200, the corresponding set of configuration 
parameters and the corresponding operating routine are loaded by processor 206 from register 210 and ROM 
212, respectively. A set of configuration parameters and an operating routine are collectively referred to as a 
configuration. Changing a configuration involves changing either the set of configuration parameters or the 
operating routine, or both. 

Fig. 3 shows a schematic block diagram of imaging system 200 of Fig. 2 configured with a platform 
302 enabling processor 206 of system 200 to access different configurations stored internally in system 200 
and, also, configurations in addition to or instead of the configurations stored internally, according to one 
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implementation of the present invention. Platfonn 302 comprises support circuits 304, an optional controller 
306, and optional memories 308 and 310. Memories 308 and 310 can be a ROM and a RAM, respectively. 
Circuits 304 can be configured to supply power and generate logical inputs aad/or clock signals for system 
200, which are delivered via pins 214. Controller 306 is configured to access ROM 308 and RAM 310. 
Controller 306 can also be configured to communicate with system 200 using an interface of choice, e.g., a 
bidirectional two-wire serial interface 312. ROM 308, which can be directly accessed by system 200 via 
interface 314, can be configured to store additional operating routines and/or additional sets of configuration 
parameters enabling additional operating modes for system 200. 

Platform 302 can be configured to support several boot options for system 200, for example, as 
follows: 

(I) Load a configuration stored internally in system 200, which configuration is chosen based on the logical 
inputs suppKed by circuits 304; 

(II) Load a configuration from ROM 308; 

(III) Load a configuration from ROM 308 via controller 306; and 
(TV) Load a configuration from RAM 310 via controller 306. 

Depending on the particular configuration of platform 302, different combinations of options I-IV may be 
available. For example, if controller 306, ROM 308, and RAM 310 are not present, then only option I is 
available. Similarly, if controller 306 and RAM 310 are not present, then only options I and n are available. 
Furthermore, if RAM 310 is not present, then only options I-UI are available. Different embodiments of the 
present invention may utilize different configurations for platform 302 and, therefore, have different 
combinations of boot options. 

Fig. 4 shows a flowchart illustrating how system 200 can be booted and operated, with the option of 
using platform 302, according to one embodiment of the present invention. After the power is turned on, in 
step 402, the system prepares itself to boot. In step 404, the system receives and interprets a boot option 
signal. The boot option signal can be implemented by a variety of methods, such as supplying a voltage 
pattem of logical "0" and/or logical "1" values to one or more pins 214 of system 200. For example, three 
pins 214 marked as A, B, and C in system 200 of Figs. 2 and 3 can be used to indicate a total of eight different 
boot options. This particular implementation is fiirther illustrated in Fig. 4. 

In a preferred embodiment, the absence of voltage on pins A-C is interpreted as logical (000) and a 
configuration designated as "default" is loaded from register 210 and/or ROM 212 during step 406 to enable a 
"default" operating mode. If a different voltage pattem is supplied to pins A-C, then system 200 proceeds to a 
selected step of steps 408 - 412 to execute the corresponding boot option. If a particular voltage pattem is 
undefined, system 200 preferably loads the intemal default configuration. In one embodiment shown in Fig. 4, 
the different boot options are as follows: 
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(i) If the voltage pattern supplied to pins A-C coiresponds to the logical value of (001), then Configuration 
#1 is loaded from register 210 and/or ROM 212 in step 408; 

(ii) If the voltage pattern supplied to pins A-C corresponds to the logical value of (010), then 
Configuration #2 is loaded from register 210 and/or ROM 212 in step 410; and 

5 (iii) If the voltage pattern supplied to pins A-C corresponds to the logical value of (1 0 1), then the 

configuration is loaded from an external memory, e.g., ROM 308 or RAM 310, in step 412. 

After flie appropriate configuration has been loaded, imaging system 200 proceeds to step 414 to 
execute an operating mode corresponding to the loaded configuration. The operating mode can be changed by 
applying a different voltage pattern to pins A-C at step 404 to cause a different configuration to be loaded. If 

10 system 200 is a digital camera, then an example of four operating modes might be still camera mode, camera 
mode with different pin assignments, bar-code reading mode, and diagnostic mode. 

Steps 415, 416, and 418 illustrate a capabiHty to load new software into system 200 using platform 
302. New software can be either permanently or only temporarily used in place of the already existing, 
intemally stored software and/or be appended to it. In one embodiment, if a voltage pattern suppUed to pins 

11 A-C corresponds to the logical value of (110), then system 200 will proceed to step 415 to temporarily load 
1^ new software from platform 302. hi step 415, system 200 communicates with controller 306. Controller 306 
yi configures system 200 to receive new software that can be a new operating routine and/or a new set of 

I J configuration parameters. Controller 306 transfers new software and/or new sets of configuration parameters 

s from RAM 310 or ROM 308 of platform 302 to system 200. This new software and/or new sets of 

|i) configuration parameters may then be used in step 414 to execute an operating mode corresponding to the new 
configuration enabled by the new software and/or configuration parameters. 

ll In one embodiment, if a voltage pattem supphed to pins A-C corresponds to the logical value of (1 1 1), 

then system 200 will proceed to step 416 to permanently load new software from platform 302. To enable the 
transfer and permanent storage of new software in system 200, register 210 and/or ROM 212 can be 

25 implemented using a programmable ROM, eleclrically-erasable programmable ROM, flash memory, or any 
other suitable memory device. After the new software has been transferred to system 200, register 210 is 
updated in step 418. During step 418, one or more addresses may be removed from register 210 to disable one 
or more old operating routines when a new address corresponding to a new operating routine is added. After 
the con5)letion of step 418, system 200 can be configured to execute the new operating mode by applying the 

30 corresponding voltage pattem to pins A-C at step 404 to cause the new configuration to be loaded. 

Other possible boot options corresponding to the logical values of (01 1) and (100) and not shown in 
the flowchart of Fig. 4 may be used for loading additional configurations stored either intemally in system 200 
or extemally in platform 302. In addition, some of the boot options corresponding to these logical values may 
be reserved for fixture configuration upgrades to enable new operating modes. In general, depending on the 

35 particular embodiment, a different number of boot options may be implemented. For example, if two or four 
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pins 214 of system 200 are configured for selecting boot options, then a total of four or sixteen different boot 
options, respectively, can be implemented. 

As is clear from the above description, system 200 caa operate in one or more operating modes, which 
can be enabled in a number of ways: 
5 (1) the imaging system can boot using one or more configurations stored internally; 

(2) the imaging system can boot using a configuration stored externally; and 

(3) the internal software that enables one or more operating modes can be upgraded or extended to modify 
an aheady existing operating mode or to add a new operating mode. 

The present invention allows a user to select a mode of operation or configure an imaging system for 
1 0 different applications, which increases versatility of imaging systems. Consequently, multiple applications can 
be enabled by essentially the same hardware while application-specific customization can be achieved by 
configuring an imaging system from a plurality of boot options according to the intended apphcation. For 
example, the suppUer of SOC imaging system of the present invention can fabricate a single design that can be 
software configured for different applications, such as video camera and still image camera. 

13 In addition, the present invention enables loading new software or adding a new capability, e.g., 

.U 

P interfacing with a new type of device. Also, special troubleshooting operating modes can be implemented for 

f1 

f ^ maintenance and diagnostics. The latter can result in more efficient product support as maintenance or 

m troubleshooting instructions can be provided by the suppher remotely based on the resuhs generated by the 
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imaging system during the troubleshooting operating mode. 



£0 In general, the present invention may be implemented for imaging sj^tems having image sensors with 

p one or more pixels arranged in either a one- or two-dimensional pattern, such as an array of pixels arranged in 
H rows and columns. Photoelements in each pixel may be based on any suitable light-sensitive device, such as, 
for example, a photodiode, a phototransistor, a photogate, photo-conductor, a charge-coupled device, a charge- 
transfer device, or a charge-injection device. Similarly, as used in this specification, the term "light" refers to 
25 any suitable electromagnetic radiation in any wavelength and is not necessarily limited to visible hght. 

While this invention has been described with reference to illustrative embodiments, tiiis description is 
not intended to be construed in a limiting sense. Various modifications of the described embodiments, as well 
as other embodiments of the invention, which are apparent to persons skilled in the art to which the invention 
pertains are deemed to he within the principle and scope of the invention as expressed in the following claims. 



Although the present invention has been described with reference to digital image sensors and SOC 
imaging system architecture, it can also be practiced for analog image sensors. For an SOC imaging system 
with an analog image sensor, the system may also need to include one or more analog-to-digital converters to 
convert the analog image signals into digital image data for storage in the memory. 
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Although the stq)s in the following method claims, if any, are recited in a particular sequence with 
corresponding labeling, unless the claim recitations otherwise imply a particular sequence for implementing 
some or all of those steps, those steps are not necessarily intended to be limited to being implemented in that 
particular sequence. 
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